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ANNOTATION 


The problem considered is that of obtaining an estimate of a 
vector involving the parameters for the state of a physical system 
when the weight matrix In the method of least squares is a function 
of this vector. An Iterative procedure is proposed for calculating 
the desired estimate. We obtain conditions for the existence and 
uniqueness of the limit of this procedure, and a domain Is found 
which contains the limit estimate. We also propose a second method 
for calculating the desired estimate which reduces to the solution 
of a system of algebraic equations. We consider the question of 
applying Newton's method of tangents to solving the given system 
of equations and obtain conditions for the convergence of the modi- 
fied Newton's method. Certain properties of the estimate obtained 
are presented together with examples. 
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1. statement of the problem 


We shall consider the problem of determining the state parameters 
of some physical system from the results of measurements (for example, 
the problem of determining the trajectory parameters for a space /3* 
vehicle from the trajectory measurements). Leti<^'be the -dimen- 
sional vector of the parameters for the state of the system which 
are to be determined, . its actual value, the , rii -dimensional 
vector of the factions being measured, >3 the vector of the measure- 
ments (i.e., the measured value of the vector dM ). We shall assume 
that the function is given. 

The given problem of determining the vector \(Jtwill be solved for 
the case when the precision of the measurements is a function of,"fJ->-. 
Such a function can stem from the following causes. 

1. The precision of the measurements can depend on the magni- 
tude of the measured function. For example, if distance is measured 
in terms of the travel time of a signal, then the precision of the 
measurements can deteriorate with an Increase in distance, due to the 
weakness of the reflected signal, due to an imprecise value for the 
propagation velocity of the signal, etc. Taking into account the 
funct iond(<j), the precision of the measurements in the case under 
consideration is a function of . 

2. The components of the vector ^ can also be Included in the 
functional relationship of the accuracy of measurements to the ^ 
sources of errors. For example, if moments of time are measured in 
which some object traverses the field of view of an optical sensor, 
then the measurement error is proportional to the time Interval during 
which the object crosses the entire field of view of the sensor, but 
this interval depends on the velocity of the object, the distance to 
it, etc, 

3. When interfering parameters are present (i.e., parameters 
of the model used which are not included Iri the number of parameters 
being determined, and are. assumed equal to a priori values) the 

^Numbers in margin Indicate foreign paginal lohV ‘ 
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measurement error vector in the linear approximation.' is calculated 
by the formula [ 1 ] 

where is the instrument errors of the measurement, d is the vec- 
tor of the errors in the knowledge of the Interfering parameters, and 
B~hd/dd . In the general case, the matrix ' 8;5 and, therefore, the 
errors in the measurement depend on .(j, . In the problem of statistical 
regression for the controlled variables which contain the errors, 
there is an analogous dependence of the measurement errors on the 
vector of the parameters to be measured [ 2 ], 

In the given case the covariant matrix of the measurement 
errors is also a function of the vector <1 , Henceforth, we shall 
assume that the function is known. 

The basic method for determining the vector '(Jt, is the method of 
least squares (MLS). According to this method, the estimate ^ of 
the vector^* is found from the condition for the quadratic form* 

:[J-d(t)];p[d_-cl((l)]! (1.1) 

where '.p is the weight matrix of the MLS. If the function (or is 

linearized in some neighborhood of the vector ) , then the weight 
matrix which ensures the minimum dispersion for the error in deter- ' 
mining any parameter linear with respect to'Cj^s the matrix 

P-D-(<}J. (1.2) 

according to the Gauss-Markov theorem. In the given nonlinear pro- 
blem we shall assume that the weight matrlc ( 1 . 2 ) is also in some 
sense the best matrix. However, since is imknown, the weight 
matrix will be computed by the formula 

where is some value of the vector q. In the general case'q can be 
distinguished from the value of the vector used to compute the func- 

* In (1.1) and hereafter the symbol "T" denotes the transpose of a 
vector and a matrix. 
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tlons being measured. Then the MLS quadratic form (1.1) and the 
system of normal MLS equations can be written in the form 

( 1 . 3 ) 

' a.h) 

where i(\(ci) = dcl/9q . According to- the assumption that the weight matrix 
(1.2) is optimum, the estimate 

(1.5) 

is the best MLS estimate. Slnce\^iis unknown, it is necessary to 
find the best approximation to the estimate (1.5). As criteria for 
the closeness of an estimate to or\4a], we shall assume the 
quantities; iHJi and ; . When selecting a vector norm it must be 

kept in mind that the components of have different dimensions. 
Henceforth, we shall assume that the vector ',qi is reduced to dimen- 
sionless form as follows (likewise foriqi): 

where !^f»' is the input vector of the parameters to be determined whose 
components are written in the given units of the dimensions, |5i is a /6 
constant diagonal matrix with positive elements which can be selected 
quite arbitrarily. The elements of '$1 can be, e.g,, those required 
for precision in determining the components of the vector jq?, . The 
matrix must be identical for all the vectors and ^ . Any of the 
norms used can be applied to the dimensionless vector qjthus obtained. 

Let be an a priori given value of the vector I q which belongs 
to a sufficiently small neighborhood of the vector fqu,. We shall 
assume that the value ;P(qJ of the weight matrix makes it possible to 
qj=_a7gmin(p(q, such that • . Since the vector 

closer to than we may expect that the weight matrix pfiji), will 

pennlt further improvement in the estimate of the vector: q 
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Continuing to reason analogously, we arrive at the recursion proce:^ 

dure* 

(k=o,],...;.: ( 1 ^ 5 ) 

In Sections 2 and 3 we shall formulate the conditions under which the 
procedure (1.6) converges to a unique estimate, sufficiently close to 
the value (1.5). Note that all the quantities which enter into the 
conditions of the theorems to be proved below are, generally speak- 
ing, random. Therefore, the conditions of the theorems must be consi- 
dered either for some concrete sample, or as realizable with a certain 
probability. 

2.. The conditions for convergence of the, procedure /7 


Let'<l«) be a fixed vector. We shall consider two neighborhoods 
of the vector • 


( 2 . 1 ) 


( 2 . 2 ) 


where',D<'^*^'^®° »/ and 

f'll when ' is the norm used 

^ v ' ' ' *n 

when Ki is the norm used 

^ 2 when , !l II *■ I : is norm used 

(here i^.\ is the the component of_t he vector <j,^). Let us also 
consider the matrlces-i (2.3) 

denotes the 'identity matrix. The fd Ilo-w in g lemma is needed to prove 
the theorem' given below. 

Lemma 1 . For any4s,<^* and any matrix 0i , defined by (2.3), 

the vector ^ . 


( 2.'0 


belongs to the neighborhood 


Proof : Let us consider the norm J^l!= Denote by , ^ii , 

the I th components of the vectors • Prom (2,4), 

(2 . 3) for all i =],m 


* An; ^analogous procedure is considered in [2] 
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iq; I = -<lJ ^ ^Ju-qJ ^(i- d, f d]} u) =^| 


Hence j 8q~qa| 

Next, consider the norm Prom (2.4) 


/8 


(2.5) 


From the definition of the matrix 0i, <■ 2 j . Let us Introduce 

the notation » 'cos/- f Since 

it follows that Hx»|<0)| and lllxj 4Ct)| * Prom this and 
(2.5) we obtain . . . . _ 

“ i JM*M-2 IxJIIxJco5/ '+ 5 J|x,ll*+||Xi||*+2|x,M|xJroo/'^ 

* f(J2-2co$/ +j 2 f 2 cos/ 7 “ ^s(n| -f-C0if)^j2cv, / 


have ; 


Finally, consider the norm ,|(^l=Z.iq{li . From (2,4) and (2.3) we 

I _ i*i 


Q.E.D. 


Denote by U' the neighborhoods (2.1) when|<Jo -qc; or > 


i.e. 


Also let 


Q=0(q«), Q'* Q'(qo) jo^. Q=Q(qJ ; Q = C^'(q.)=' 




Mil •< 


( 2 . 6 ) 


(2.7) 

( 2 . 8 ) 

where 't is defined by (1,5). Along with the vectors ^ we 

shall also use the composite vectors 
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where 


2 = 







(2.9) 


the estimates 
tlons Introduced above 
land IH(2).l 


are determined by (1,6). Then the func- 
can be written in the form;ip(2), !f-(z), j|G(h)‘ > 


Theorem 1 . Suppose that the following conditions are satisfied: 

1 ) {! 

2) all the terms of the- sequence^{^*} constructed according 
to (1.6) belong to 

Moreover, assume that for any the following conditions are 
satisfied: 

3) the derlvatlves[Q(2)» h(h) exist ; 

4) the matrix 'Cl'‘(2) exists ; 

5 ) ' H (i)l ^^0 9 Ocdo^l^ 

Then the following statements are valid: 


a) for any term jjjg of the sequence the quantity 

is uniquely determined in Q by (1.6) (i.e, ,lminvf(cj,^K)|is unique in fi);| 
the estimate is also unique in 

b) the limit of the sequence w exists , q^ls a 

solution of the equation , and this solution is unique in 

c) the estimate (J# satisfies the inequality 

( 2 . 10 ) 


\ a * A 


-U ‘ rl 




where A. is defined by (2,8). 


Proof : /IQ 

a) assume that for some there exist £ Q. It 

follows from (1.4) and (1.6) that f(4», 0 • There exists 

a vector q • * where the matrix ©i is defined by (2.3) 
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andiq^^Q'by Lemma 1, so that 

i f( 

By condition 4) of the theorem, the matrix G is nonsingular every- 
where in Q' ; hence ; .■ 

The uniqueness of the estimate is proved similarly. 


b) by virtue of (1.4), (1.6) and taking into account the 
notation (2,9) 5.J-0, Hence it is possible to write the 
equality _ - . . _ _ 

- ■' 3 ; - - ( 2 . 11 ) 

where 'Z»2L«-i , the matrix 02 is ‘defined" by (2.3) and 

lj,gQ%Q', according to Lemma 1. Let us Introduce the notation 

, where and are terms of the sequence Then 

by (2.11) and conditions 4 and 5) of the theorem we obtain 

From this and the triangle Inequality we obtain for any K, = 0, 1, 


St?d »♦>•! . ^ a At* 

S’ ^ A,.o^6 „‘= a,.o5/ 


According to condition 2) of the theorem, A, „ ^2co 


. 2co6o 
' l~do 


( 2 . 12 ) 

and from (2.12) 


/II 


Thus the conditions of the Cauchy criterion for the convergence of 
the sequence {%<] , formed in accc^dance w^ith (1.6), are satisfied 

[3]: for any e > 0 there exists K, -f£n ' the brackets denote 

' L . 

here the integral part of a number) such that for any K > K^, 't>0' 
the Inequality is satisfied. Consequently, Eon' = 

exists and £J«€Q , since (K = 0,1,,,.), Since = or 

all K, • 
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Assimie that there exist ql^O such that . and |i (2 

{ 0 1 — — ' — - " 

where ” 1»2.). By analogy with (2.11) we write: 

' ^ ■ ■ 

f (2«) 'f(Hi) =G(2)(qt-a')^- H(z}(q ^ -qih 0 , 

— - ^ - (2.13) 

where \£ = 2^+0j(2f- 2^) and i . Prom (2.13) and condition 

5) of the theorem^ 

This contradiction proves that the solution of the equation = 0 

Is unique In 

c) In accordance with (1.4), (1.5) j m-A.) ~0 and by analogy 
with (2,11) and ( 2 . 13 ) we may write 




f^2.) - f (2.) " 0 , ( 2 _ j 

where - — •— — 

and according to Lemma 1, Z e x » From (2,l4) and conditions- 
4) and 5) of the theorem 




(2.15) 


Hence, taking Into account (2.8), the first of the Inequalities (2.10) 
follows. The second Inequality follows from the first: /12 

' - ' 

Q • £ . D . 

/13 

Corollary 1 . If the conditions of Theorem 1 are satisfied, then 
for any Q, the equality Is a neces sary and sufficient 

condition for the validity of the equation 


Necessity follows from (1.4) and- sufficiency from the uniqueness 
of the solution of the equation which Is proved In a manner 

analogous to the proof of assertion a) of Theorem 1. 
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Cor;®;! lary - 2 . The rate of convergence of the sequence 
constructed in accordance with the procedure (1.6) Is estimated by 
the Inequalities 

: , (2.16) 



(2.17) 


For the proof of (2.l6) we write by analogy with (2.l4) 

+ Hla-Ki;. -<i.) ' 0 , 

where . Hence, and also from condition 5) of Theorem 

1, the inequalities (2.16) follow. The inequality (2.17) is an 
immediate consequence of (2.12) when-t-^^oo. . 


Note 1 . If the derivatives (2.7)' are continuous in Q' , then 
according to a theorem about implicit functions and condition 4) of 
Theorem 1, the relation ^((^,^)=^O^uniquely defines for any a 

continuously differentiable function 

•' ( 2 . 18 ) 

It follows from condition 5) of Theorem 1 that the mapping (2.l8) is 
compact for alllc^/^fe^^ and Theorem 1 can be proved with the help of 
the fixed point principle [3]. 

Note 2 . In the general case the limit of the procedure (1.6) 
is not the minimum of the sequence In fact, at some stage 
of the procedure, it may turn out that Then according to (1.5) 

and (1.6), and due to the uniqueness of the vectors and , 

the equalities and are valid, whereas in the general 

case, zero. 

Note 3 . In real problems there is interest in the case A << to. 

In the contrary case, any estimate from even including 4 = 
good in the sense that '' * 

Note that in real problems involving the determination of orbits, 
the conditions l)-4) of Theorem 1 are usually satisfied and condition 


9 



5) is basic. Satisfiability of this condition is illustrated by an 
example considered in Section 7. 

3 . Improvement of the estimate obtained 


Prom (1.^) and (2.7) it is easily seen that the matrix H is a 
linear function of the vector of the residual )whe re as the matrix G 

does not depend on this vector. If the estimate (1.5) is the best MLS 
estimate, then the residual, computed from this estimate is mlnlmimi 
in the mean. Therefore, it may turn out that the quantity |GJ'H|| , 

computed in- a sufficiently small neighborhood of the vectors and 
will be substantially smaller than the quantity V5o J flC'H f| /l4 
In this case a more accurate estimate of the norm[|G*'H^ may permit a 
decrease in the neighborhood of the vectors ,4^, and which contains 
the limit of the procedure (1.6), i.e., the right side of the 
Inequality (2.10) is reduced. Moreover, note that 6^ is a nondecreas- 
ing _function of 03 'in_(2.T) (in fact, when 03 Increases, the quantity 
^axlGJill can only Increase). Since the estimates (2.10) are accept- 
able only when 6 is sufficiently small (say, not more than 1/2), then 
this imposes a restriction on w. Therefore, estimates of the closeness 
of the quantity 1^*', to ' 


and independent of 6^ make it possible 
to widen the neighborhoods and Q'. Other estimates will be obtained 
below. 


Suppose that Instead of condition 5) of Theorem 1, the following 
condition is satisfied: for any 

' jG'ftr? ) H(?. f I >1/1 (3.1) 

where 

0< 6(x,y)4 d,< i , (3.2) 

and _ _ _ 

^ = l]^-qz/h (3.3) 

Here !9i' and are vectors. If condition 5) of -.Theorem 1 is satis- 
fied, a function 6(x,y), which satisfies (3.2), can be constructed as 
follows : 
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( 3 .^) 


Consider the function 

\j{u)^ max 6(x,y) , 
. V(u) 

where 

yi^) = ihy,‘ ^ ^ 


(3.5) 

(3.6) 


(3.7) 


A Is determined by (2.8). 

Note that when choosing the vect-ors l^^iand'^Uln (3-3) _lt Is 
possible to make use of one of the following criteria: 

the precision of the estimate (3.1); 

the structural simplicity of the function 6(x,y) (for 


/1 5 


example, the simplicity with which the maximum In (3.^) Is calculated); 

— ^ the computational simplicity of the function w(u) which will 

be needed subsequently (for example. If such and can be chosen 
that 6(x,y) Is a monotonlcally Increasing function of both variables, 
then according to (3.5) and (3.6) , = . 


Consider the sequence {U }, formed In accordance with the equal- 


Itles 


and the equation 




(3.8) 


u(u)A 

i-w(u) 


(3.9) 

It Is clear from (3.5) and (3.2) that any solution of equation 

(3.9) satisfies the Inequality 


0^ U«4 


1-dc ' 


(3.10) 


Lemma 2 .. Assume that the function 6(x,y) satisfies the Inequal- 
ities (3.2) for any Then the following assertions are valid; 


a) the sequence Xuj*} j formed In accordance with (3-8), has a 
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limit which is the greatest solution of equation ( 3 . 9 ); 
b) for any u^, the inequality 

/16 

[ (3.11) 

is satisfied, as is the inequality . 

Proof ; 

a) It is easy to see that aj(u) is a nondecreasing function. 
Indeed, for any u', u"'such that u'< '.u", it follows from (3-6) that 
W(u’)CW(u") and according to (3.5), w(u' ).^a)(u" ) . 


Consider the sequence From (3.5) and (3.2) we find that 

w(U )^5 q. Hence from (3.8) . Therefore, since the function 

o)(u) is monotone , . 0 ) (U-i )^m(U^) , and from (3.8), U 2 ^ Ui. Reasoning 
analogously, we find that ( K • 0 ,lj,,o). It is clear from ( 3 . 8 ) 

(3.5) and (3.2) that every U^^O.. Consequently, is a monotonl- 

cally decreasing sequence which is bounded below, and has a limit ,M_<t 
which satisfies the inequalities (3.10). Clearly^, is a solution 
of equation (3.9). Assume that there is a solution U* ' of this equa- 
tion such that U^>U*,. Note that' U, ♦Wk for all determined by (3.8), 
since, if for any K,,Ui*Uct, then Uj^ is a solution of equation ( 3 . 9 )-; 
and, according to ( 3 . 8 ),U 0 «l/« ••• • U* ^ contrary to hypothesis,. 

On the other hand, for , as for all solutions of equation (3. 9) , 
the inequalities (3.10) hold. Consequently, by hypothesis, 
and there exist terms and of the sequence such that 

'Hence, and also from (3.8) and the monotonlclty of the 
function o)(u) , we.'^f ind ‘that : 


ui ' u,„. 


1 ' 




i-wiui) * 
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The solution obtained contradicts the fact that is a solution of 
of equation (3.9). Hence Ua. is the largest solution of that equation. 

b) Suppose that is the largest solution of equatlonr ( 3. 9 ) . 
Assume that some satisfies the inequality (3.11). Construct a 
sequence {UgJ in accordance with the equalities 
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n 




(3.12) 


Hence, In view of (3.11), it is clear that ■ W, $ . Consequently, 

, and from (3.12), . Continuing this line of rea- 
soning, we obtain « ® O,!,...) . Here, since for all 

',Ur , the inequality '^*4 "5°^ is satisfied. Consequently, 

.. 

- : 

K}: is a monotonlcally increasing sequence which is bounded above, and 
this sequence has a llmitil/ff which is a solution of the equation (3.9), 
and >Ua^u’>U(t . But, according to this condition is the largest 
solution of equation (3.9). This contradiction proves assertion b) 
of the lemma, and the lemma is proved. 


Theorem 2 . Suppose that conditions l)-4) of Theorem 1 are 
satisfied, and for any so are the conditions (3.1) and (3.2). 
Then assertions a) and b) of Theorem ,1 hold and 

- *■ (3.13) 

where is the limit of the sequence formed according to (3.8), 

and is the largest solution of equation (3.9). 


Proof : 


The validity of assertions a) and b) of Theorem 1 are obvious, 
since from (3.1) and (3.2) condition 5) of Theorem 1 follows. 

Consider the equality (2.l4). The vectors [tj' and , components 
of the vector Z in (2.l4), satisfy the inequalities 
' '. Hence, making use of the triangle inequality, 

taking account of the notations (3.3), (3.7), (2.8) and 

/18 

U* * •' (3.l4) 

we obtain: 

(3.15) 
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Prom (3.1), (3.5), (3.6), (3.15) follows 

wfuv. 


(3.16) 


Prom (2,l4) and (3.16) j taking into account (2.8) and (3.14), we ob- 

similar to (2,15). Hence, It follows that U’ satisfies (3.11). 
According to Lemma 2, , and hence, by virtue of (3.14), the 

inequalities (3.13) follow. Q. E. D. 

The results of Theorem 2 make it possible to reduce substantially 
the domain in which the estimate lies in case its magnitude is 

close to unity and U(Ut)<>-do • This is graphically illustrated in 
the example considered in Section 7. 


4. The second method for obtaining an estimate 


/19 


In computational terms the procedure (1,6) is laborious, since 
at each step an ordinary MLS problem must be solved (with a constant 
weight matrix). Therefore, we shall make use of the fact' that if the 
conditions of Theorems 1 and 2- are satisfied, then the procedure (1.6) 
is equivalent to finding a solution to the equation 

( 4 . 1 ) 

(the equivalence follows from assertion b) of Theorem 1). From a 
computing standpoint, the procedure involved in solving equation (4.1) 
may turn out to be simpler than the procedure (1.6), since it allows 
us to avoid inserting iterative processes. 


Let us consider solving equation (4.1) by Newton's method of 
tangents. According to this method, given an initial approximation 
, a solution is found as the limit of the sequence formed in 
accordance with the recursion procedure [3-5] 


MU 






(4.2) 
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From (2.7) we have 


. 9 (^ 

and the procedure (4.2) assumes the form 
where 

^e shall show that the Inverse matrix in (4,3) exists. 


(4.3) 


Lemma 3 » If the conditions of Theorem 1 are satisfied, then 
for any Zefi^xQ^, [G(Z)+H(Z) ]~* exists. 


Proof : 

720 

Let us show that the matrix G ^ (G+H)=I+G~^H Is nonsingular; 
then since the matrix G~^ Is nonsingular, we shall have proved the 
nonslngularlty of the matrix G+H. Suppose Is any vector. 
According to condltlon;'5 ) of Theorem 1, we have 




(4.4) 

Since lt_follows from (4,4) that the equation (I+G”^H)q=0 

has only a zero solution. Consequently, the matrix I+G”^H, and 
with It the matrix. G+H also. Is nonsingular, Q, E, D, 

We shall assume that the remaining conditions for the conver- 
gence of Newton's method are satisfied*. Then the procedure (4,3) 
converges to the same limit <^4 as the procedure (1.6), 

5. Simplification of the computing procedure 

The procedure (4.3)j along with previous procedures, also has 
defects In comparison with the procedure (1,6), Including the necess- 


* Various conditions for the convergence of Newton's method are consi- 
dered In [3-5]. For example, a sufficient condition for convergence 
Is the existence of a bounded second derivative of the function [4], 
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Ity of computing the matrix H at each Iteration (It Is easy to see 
that when minimizing the function with respect to q by Newton's 
^method It Is not necessary to compute this matrix). Therefore, let 
us consider the conditions under which the procedure 

— in. 

** fx (^‘ 0 , 1 ,,.^), (5.1) 

where 

- ^ — — - - (5.2) 

converges to the same limit', as the procedures (1,6) and (4.3), 

Note that (5.1) Is a modification not only of the procedure (4.3), 
but also the procedure (1.6) In the case when the minima In (1,6) are 
found by Newton's method. Indeed, If In this case the procedure (1.6) 

Is changed as follows: each minimum Is not calculated Individually 

after fixing the weight matrix:, but at each Iteration of Newton's 
method the value of the vector q obtained In the preceedlng Interatlon 
Is substituted Into the weight matrix, then we arrive at procedure (5.1). 

In order for the procedure (5.1) to converge to , It Is 
sufficient for any terms of the sequence .determined by (5.1) to 
satisfy the Inequality 

We shall formulate a theorem In which the convergence of the procedure 
(5.1) Is proved under a condition of quite weak dependence of the 
matrix ; on,q.,' 

Theorem 3 . Suppose that the conditions of Theorem 1 are satis- 
fied together with the following conditions: 

1) all terms of the sequence hit constructed according to (5.1) 
belong to the neighborhood fi determined In (2.6). and (2.1);' 

2) for each term of the sequence there exists such a vec- 
tor 9»€Q that > and for all = ) , where the 

^matrix 8 determined by (2 . 5 ) , the • inequality 
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(5.4) 





is satisfied _ /22 
where G« is determined by (5.2) andj^^.ls determined by condition 5) 
of Theorem 1. 


Then the procedure (5.1) converges to the same limit as pro- 
cedure (1.6). 


Proof : 


As follows from the conditions of the theorem, for any term of 
the sequence'£<j^*(iythe quantity determined by (5.2) can be represented 
in the form 

~ — — r~. ~ (5.5) 

where G»G(q4lK and \qeQ‘_ in accordance with 

Lemma 1. ■ 

Prom (5.1) and (5.5) we have 


The inequality 








(5.6) 


(5.7) 


is proved entirely in the same way as the inequality (2.l6) (taking 
into account the fact that . Consequently, we obtain 

8»B-<rcs (iij; : ^ 

from (5.4), (5.6) and (5.7). Let ; 'then by (5.4), B<1. 

Hence, for any terms of the sequence w , the inequality (5.3) is 
valid, Q. E. D. 

723 

It is easy to see that in linear problems (i. e., if the matrix 
A in (1.4), and , therefore, according to (2.7) j the matrix G also. 
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does not depend on q, the procedures (1.6) and (5.1) coincide. 

We shall prove one more theorem about the convergence of the 
procedure (5.1). 


Theorem 4 . Suppose that the conditions of Theorem 2 and the 
following conditions also are satisfied: 

1) all the terms of the sequence constructed according to 
(5.1) belong to the neighborhood defined in (2.6) and (2.1); 

2) for each terml^C^'lof the sequence',{(^^|,and for the vector 

(5.8) 

wherelG^land are determined by (5.2) and the inequality 






s> I 


(5.9) 


is saMs^fiedj where is the limit of the procedure (1.6) or (^.3)j 

(the function 6(x,y) is defined in Section 3) » e>0 
is an arbitrarily small quantity, the same for all K = 0,1. 


Then the procedure (5.1) converges to 


Proof : 


Prom (5.8) 


From (5.1) together with (5.10) we obtain • 

* - Gr(G: -crn'. (?: -«) , 

Hence from (3.1) and (5.9) 


(5.10) 


(5.11) 




(5.12) 
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Let ‘p*Swp[o(»4-5n(l+a,)]| ; by (5.9), . Hence, for any terms 

of the sequence the Inequality (5.3) holds, Q. E. D. 


Note 1 . If the center of the neighborhoods and 9 ,' is the 
vector (i.e., in (2.1), \^g=5<> ) , then to satisfy the condition 

of Theorem 4, it Ss sufficient to satisfy the inequality 




(5.13) 


1 ) 


where I and w are determined by (2.1) and (2.2). In particular, 
when*^^>) = 2 condition 1) is always satisfied, since according to 
Theorem, 


To prove this assertion, set K = 0 in (5.11). Since = , 

then for|Go'-and iHo conditions 3) and ^) of Theorem 1 and (3.1) and 
(3.2), and for (determined by (5.8)), condition 2) of Theorem 4 
are satisfied. Hence, f or the Inequality (5.12) is satisfied. 
Taking into consideration the inequality <1 l(K-0,Io..o)i 

we obtain __ 

j iq'i-t. Il 4 H + 9 - 'i* « ' 2 lit'.- U 4 

from (5.12) and (5.13). Consequent ly.L^tQ* . By analogous reason- 
Ing for K = 1,2.... it follows that all'c^J^^Q', Q. E. D. 


Note 2 . Theorem 4 is also valid of Instead of conditions 1) and 
2) of Theorem 1, only the existence of a solution (and even 

) of equation (4.1) is required. However, it must be kept in 
mind that, in this case, the inequalities (3.13) cannot be satisfied 
and nothing can be said about the closeness of the solution and 
and ' . 


Note that the results of Theorems 3 and 4 are applicable to the 
general case of the solution for a system of equations represented 
in the form (4.1). 

725 

6, The properties of the' estimate' obtained . 

Let us consider the properties of the estimate obtained as 
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the limit of the procedure (1.6) or as the solution of equation (4.1). 
Here we shall assume that in all the cases considered below the con- 
ditions of Theorems 1 and 2 are satisfied. 

1. The algorithm for estimation with whose help the estimate 
iV* is computed, is single-valued and unbiased (i.e., the estimate 

is unique and in the absence of measurement errors it coincides with 

[ 1 ]). 

The single valuedness of the algorithm was proved in Theorem I, 
and the absence of bias follows from the lack of bias of the estimate 
[1]: In the absence of measurement errors in (2.10), A = 0 and 

consequently, . 

2. If the functions being measured are linearly dependent on 

q, and the measurement errors are not biased, then the estimate 
is unbiased when the weight matrix is fixed (i.e., if the matrix 
R“Pf<i.) is fixed, then ). 

This property follows from the absence of bias in the MLS esti- 
mate with a constant weight matrix in linear problems [1], Conse- 
quently, any estimate determined by (1.6) is unbiased and a limit 
estimate is also not biased. 

3. If the estimate is consistent and effective [1], then 
the estimate is also consistent and converges with respect to 
probability to the effective estimate. 

This property follows from ( 2.10), since if the estimate is 
consistent, then the quant it y''’'A^‘in (2.10) converges with respect to 
‘probability 'to zero. 

It is easy to see that all the properties considered are also 
valid for the estimates determined by (1.6). 
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The limit properties of the estimate given be_low are proved in 
[2] for the case of a diagonal weight matrix and do not require that 
condition 5 ) of Theorem 1 be satisfied (however, the existence of the 
derivatives with respect to q of the measured functions up_tp and 
Including the third order and of the weight matrix elements is 
required) : 

1) the procedure (1.6) converges with respect to probability; 

2) the estimate 'P,*; obtained as the limit of the procedure (1.6) 
has an asymptoticly normal distribution; 

3) the estimate' is consistent in the sense of convergence almost 
certainly. 


Moreover, in [2] it is shown that the estimate obtained by mini- 
mization with respect to q of the function f(q,q) defined by (1.3) is 
not consistent even in the case of a diagonal weight matrix. In the 
first approximation this estimate coincides with the estimate obtained 
by the method of maximum probability [1] with normally distributed 
measurement errors. In fact, in view of (1.3) and the relation 
iPHl-Dli) , this method reduces to finding the maximum of the function 

!L(n)“'iet[p((})]exp[-v((i,(ij] ; (6.1) 

If we neglect the fact that the determinant of the weight matrix 
depends on q, then maximization in (6.1) reduces to minimizing the 
function 'i'(q,q). 



Suppose that q is a scalar (i.e., M = 1) and the functions to be 
measured are linear with respect to q. In this case we may assume 
that the quantity q itself is measured, i.e., the functions to be 
measured are reduced to the form 


eSi - . 


‘ ' (7.1) 

by elementary transformations. It will be assumed that the measure- 
ment errors are not biased and not correlated among themselves and 
their mean square deviations (m.s.d.) are linearly dependent on 
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( cf . Section 1) : 

^ (^”is^)> (7.2) 

The smallness of the factor',®.' In (7.2) Is illustrated by the follow- 

i ^L— 

ing example: if distance is being measured, then as distance Increases, 

let us say, per 1 km the error in the measurements Increases substan- 
tially less than by 1 km. It is to be expected that in this example 

-ii -6 • 

e does not exceed a magnitude on the order of between 10 and 10 * 


From (1.4) and (7.1) we have: 




- ^ 


(7.3) 


where = are the measurement errors.;' "From (2.7), (7.3) and 

(7.2) we obtain 


m-ih 





(7.4) 

Obviously, if for all O;j<0(tBi7n) , then conditions 3) and 
of Theorem 1 are satisfied. The msd of the errors 1^^ equal ; we 
shall assume that 


4) 




(7.5) 


Then follows from (7.4), (7.2), (7.5) 
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' ,‘2(36jr,M^+l<}-<}J(nai(!^) 


(7.6) 

Assume and as neighborhoods cf the vector (J,^ (1 . e . , in (2.1), 

). Note that in (2.1), ’ =-.^1 (i.e., n=J^"), since for M = ,1 
all three norms in (2.2) coincide. It is easy to see than when 

, the right side of the inequality (7.6) assumes 
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the greatest value In f2. Set the quantity 6^equal to this maximum; 
we obtain from (7.6) and (7.2) 


<2(3£mdx=-%— + 


where 


^ uUn /Q{| 


6«i > 

/ 


Prom (7.7) 


^ 2+6.^ 


iS 


(7.7) 


(7.8) 


(7.9) 


It is evident from (7.7) that if o)<-^ and e« 1, then condition 5) of 
Theorem 1 is satisfied (i.e., 6 <1). Here, according to (7.2) and 
(7.8) 

StCi) 


J(eQ f ^€52 S-6J ^ ^ 


i.e., the msd of the errors in the measurements can vary less than by 
a factor of 2. 


Let|9o€Q 'and e « U (the latter condition is satisfied for suffi- 
ciently large 6 according to (7.2)), Let us show that in this case 
conditions 1) and 2) of Theorem 1 are satisfied, /29 


We shall assume that 


- - (7.10) 

The deviation occurring in (7.10) with respect to the error in deter- 
mining the parameter by MLS is calculated by means of the formula 

’D(y-|G-'UF- 


(7.11) 


Prom (7.^), (7.2) and (7.8) we obtain 
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'I > e* !T,;s( |,f - i 


(tS)* ■■ 


and from ( 7 • 10)- ( 7 .12) 


:A^36S . 


(7.12) 


(7.13) 


Therefore, when e «6'‘, we have A « o) and' 4 u€Q, according to (7-9) 


and (7.13). Since |g^ , condition 1) of Theorem l is satisfied. 


o 


We shall show by induction with respect to K that condition 2) 
f Theorem 1 is satisfied whenj<Je€ Q .and e « 6^ . Since , it 

follows that!§*€Q'. Assume that for some K = 0,1,..., j 
Since the problem under consideration is linear, then, as remarked in 
Section 5j the procedures (1.6) and (5.1) coincide and, according to 
(5.1), (7.3) and (7.4) 


(7.14) 



where . We shall assume that 


From (7.14) follows: 


i' ^ 

We obtain from (7.2), (7.8), (7.9) and (7.12) 


(7.15) 


(7.16) 
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/ iGtt J1 'i: ^ “^4 (|sj% = 


(7.17) 
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Then from (7.15)-(7.17) we find that 




and when 


( 7 . 18 ) 




so that according to (7-9), Q.E.D. 


Let us now find the quantity \u# which occurs in the inequality 
(3.13). Set 


where X and Y are determined by (3.3) when • According to 

(7.6), (7.2) and ( 7 . 8 ) , [|G''HU 6(X,y)| . Since the function (7.19) is 
monotonlcally Increasing, it follows from (3.5) and (3.6) that 
w(u) = 6 (u + A, u + A), and the equation (3.9) assumes the form 


;U« 2a 


3£S-f At U 
S-6€S~3u“3a 


and ‘U< is the greatest solution of this equation when o)(u) < S . 
Taking (7.2) into account we obtain 

I M**«^(3es+A)^12eA4 36£^s . 

’ " ■ ■ ■ ■ (7.20). 
with accuracy with respect to small e up to the second order..;, it is 
clear from (3.13) and (7.20) that when e is sufficiently small, the 
quantity practically coincides with , and the estimate of /31 

closeness 9* and for the quantity close to unity is better by{ 
almost a factor of two than the analogous estimate for K = o,l,...) 
according to (3-13) and (7.13). 


In conclusion, the author expresses appreciation to G. A. Mersov 
for valuable comments and advice regarding the present paper. 
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